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ABSTRACT 

Ih 1965, the National Science Foundat 
experiment in institutional funding, the Science Deve 
program. Setting as dual goals an upgrading of the sc 
capabilities of second-tier universities and a broade 
distribution of scientific resources throughout the n 
program awarded over $130 million to selected univers 
1960's and early 1970«s. In an effort to assess the i 
fundijig mechanism, the National Board on Graduate Edu 
an evaluation of the SD program. The data gathered fo 
covered the 15 years from 1958 through 1972. All nonf 
doctorate-producing American universities were used a 
three fields that received the largest share of the S 
chemistry, physics and mathematics. Among the major f 
that the funded institutions registered increase i 
publication in key journals and were able to attract 
graduate students as measured by an improvement in th 
first-year graduate students on the Graduate Record E 
the 31 universities in 21 states that yere funded, 25 
were distributed among 17 states that did not have a 
university in 1965. Therefore, the goal of geographic 
funds was largely achieved. (Author/JILH) 
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During 1971 the National Science Foundation (nsf*) suggested to the Na- 
tional Academy of Sciences that an evaluati vc study be made of the Science 
Development (SD) program Just then drawing to a close. The program was 
a unique kind of venture not only for nsf, but also for all federal govern- 
ment agencies involved in assisting higher education. Comprising three 
subprograms— University Science Development* Department Science 
Development, and Special Science Development— the Science Develop- 
ment program was aimed not at support of project research* but at institu- 
tional building. 

The National Academy of Sciences proposed that the National Board on 
Graduate Education (NBGE), an organization sponsored by the Conference 
Board of Associated Research Councils, undertake the desired study. 
Since nbge had been established to consider the problems confronting 
graduate education in the I970's, and especially the problems arising from 
the changing concern of the federal government with science research and 
graduate education, the Board members decided that the challenge of 
making such an analysis should be accepted. As a result, arrangements 
were made whereby an inquiry into the impact of the nsf Science De- 
velopment program upon the science capabilities of the institutions in- 
volved could be undertaken. 

In de.signing the study and in interpreting the results* nbge and its staff 
were fortunate to have the assistance of an advisory panel of knowledge- 
able individuals who provided insight into the development of university 
science capabilities and made numerous suggestions regarding statistical 

iii 



and other aspects of evaluation technique. Members of the panel were as 
follows: 

John Millett, Vice President and Director, Management Division, 

Academy for Educational Development 
Donald Campbell, Professor, Department of Psychology, Northwestern 

University 

Paul Chenea, Vice President, Research Laboratories, General Motors 

Technical Center 
Robert Christy, Provost, California Institute of Technology 
J. Patrick Crecine, Professor, Institute of Public Policy Studies, University 

of Michigan 

Hans Laufer, Professor, Biological Sciences, University of Connecticut 
J. Ross MacDonald, Professor, Department of Physics, University of 
North Carolina 

Lincoln Moses, Dean of Graduate Studies, Stanford University 

The study was directed by David ET Drew, Project Director, with the 
assistance of Joan Creager, Margo Jackson, Ronald Karpf, Marilyn Block, 
Edward Dolbow, James Bliffen, and Carol Cini, Financial support was 
provided by the National Science Foundation, 

Evaluation of the performance of organizations or enterprises is scarcely 
an exact science , It is relatively easy to assert that evaluation begins with a 
carefully formulated set of objectives, examines the degree to which those 
objectives have been accomplished, reviews the complexities of the per- 
formance process, and assesses the costs and benefits of the organized 
endeavor. The difficulty with such an evaluation process is simply that no 
study yields sufficiently clear-cut, objective data from which readily ac- 

/ceptable conclusions regarding **quality" or **value" can be' logically 

/ inferred. The success of an evaluation remains in large part a judgment to 
be madp by each reader. 
At the sam^etime, in spite of its diftlculty, the task of evaluating intangible 

^ QUtoJUies cannot be set aside or avoided. Evaluation is an indispensable 
part of social behavior, and only as the process becomes more explicit, 
more exact, and more familiar can progress in responding to this vital 
concern with the performajice of programs and organizations be realized. 

It is in the spirit of acknowledging an urgent social concern, of seeking to 
advance the art and science of evaluation, and of accepting a challenging 
task that the National Board on Graduate Fducatipn presents this report, 

David D, Henry, Chairman 

Nationjil Board on Graduate Education 

January 1975 
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In 1972, considering whether to undertake an evaluative study of the 
Science Development program, the National Board on Graduate Educa- 
tion (nbge) discussed at length how such a study would fit into its total 
program of activities. At that time» the Board saw the potential benefits of 
the proposed study as including information and insight into a number of 
important issues, including: 

1. the measurement of quality in graduate education and research in the 
sciences, and the factors that influence quality; 

2. the strengths and weaknesses of the particular funding mechanism 
used in the Science Development program* and its relation to other federal 
funding mechanisms* such as project grants or training grants; 

3. the issues involved in the explicit policy decision of the federal gov- 
ernment to encourage geographical distribution of federal funds for re- 
search and graduate education, including the impact of this policy on the 
quality of graduate education, its impact on established universities, and 
the assessment of this policy in terms of regional benefits and costs; 

4. the effects of large scale funding for science on the other disciplines 
within universities; and 

5. questions of method in the evaluation of social programs, and 
academic programs in particular. 

The completed study, reported in this document and in the companion 
technical report by David E. Drew,* the study's Project Director, has 
provided valuable information on a number of these and related issues. The 
effects of the Science Development program have been assessed in detail 
by a combination of statistical analyses, site visits, and applications of 
informed judgment. Much has been learned about the objective correlates 
of graduate program quality and the degree to which the Science Develop- 
ment program was successful in enhancing the quality of science graduate 
education in geographically dispersed universities. Perhaps most signifi- 
cantly , the study was able to delect and measure several ef'^'cts specifically 
attributable to the Science Development program; this alone differentiates 
the study from many evaluations of heavily funded governmental programs 
where few, if any, significant effects were found and substantiated. This 
suggests that the study's major contribution may be to the growing litera- 
ture on program evaluation. 

In placing the study in the context of graduate education, it should be 
noted that it was not possible to investigate comprehensively a number of 
issues closely related to some of the objectives of the Science Development 

* David E. Drew. Saem e Dexelopment. An E\aluanon Study. (Washington, D C: National 
Academy of Sciences. 1975). 



program. The sJudy design niled out analysis of an exhaustive list of 
attributes of graduate program quality: understanding of that subject has 
been advanced, but investigation of additional aspects of quality in 
gniduate education is clearly warranted. Limitations of time and resources 
made it impossible to investigate in detail the impacts a major university 
has upon its state and region, nor was it possible to pursue the question of 
how many major research universities are needed in the United States, A 
rigorous comparison of the relative effectiveness of various mechanisms 
(institutional grants, project grants, training grants) for federal funding of 
scientific research and advanced education was not possible, nor did the 
study attempt a retrospective cost-benefit analysis of the economic value 
of the SD program to society. In short, the study does not lead directly to 
policy conclusions in some areas of concern, a limitation that e.xplains the 
absence of nbge recommendations for federal policy in those areas. 

The study has established, however, that institutional development 
grants were effective in achieving a number of the goals set for them, 
indicating that this form of funding mechanism cx)uld reasonably be used as 
one model for future programs, 

David W, Breneman, Staff Director 
National Board on Graduate Education 

January 1975 
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Preface 



This summary of an evaluative study by the National Bo^rd on Graduate 
Education was first drafted by a panel appointed by the Board, and then 
revised in accordance with the suggestions of the Board members. The 
panel could not have accomplished its task without the professional assis- 
tance of David E. Drew, the project director, and the members of the 
project staff. 

The role of the panel was actually twofold. First, the panel served as a 
mechanism for advising the staff in preparing the study outline and in de- 
veloping the study data. Several members of the panel were specialists in 
the techniques employed in this evaluation, and their contributions were 
invaluable. 

Second, the panel undertook to set forth its general interpretation of the 
data and to formulate the generalizations to be drawn from the study. 

The panel is pleased that the National Board on Graduate Education has 
seen fit to associate its own views with those of the panel. In fact, through- 
out the study, a close relationship existed between the study director, the 
study panel, and nbge itself. Board members made helpful suggestions 
about the prosecution of the study and about the conclusions to be drawn 
from it. 

Well aware of the intricacies involved in evaluating higher education 
performance, and especially in assessing the quality of that performance, 
the panel has no illusions that this study has written the last word on 
evaluation. It is hoped, however, that the study has contributed to the 
development of evaluative technique. 
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At the same time, evaluation calls for the exercise of judgment. The 
panel, as well as nbgk, has endeavored to state conclusions that are based 
upon objective evidence and on reasonable and responsible judgment. 

John D. Millett 

Chairman of the Panel 

Science Development Evaluation Study 

January 1975 
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Highlights of the Study 



In l%5» the National Science Foundation (nsf) began an experiment in 
'institution«0 funding, the Science Development (so) program. Setting as 
twin goals a dramatic upgrading of the science capabilities of second-tier 
universities and a broader geographical distribution of scientific resources 
throughout the nation, this program awarded over S230 million to 
selected universities during the I960*s and early 1970*s. In M effort to 
assess the impact of this unusual funding mechanism, nsf asked the 
National Academy of Sciences to evaluate the Science Development 
program. The Academy, in uirn. requested the National Board on 
Graduate Education to undertake the study. That work has now been 
completed. The methodology of the study and detailed findings from 
both a series of site visits and a large number of quantitative analyses are 
discussed in a companion document: Science Development: An Evalua- 
tion Study, by David E. Drew, the p^pject director. 

Several technical decisions were made at the outset to help isolate the 
unique effects of Science Development. First, wherever possible, the 
data gathered for this study covered the 15 years from 1958 through 
1972. Second, all (nonfunded) doctorate-producing universities in the 
country included in the 1969 American Council on Education survey of 
graduate pr^rani quality' were used as controls. Third, the three fields 

' Kenneth D. Roose and Charles J. Andersen. A Rating of Graduate Proiinims 
(Washington. D. C : American ^oiincil on Hducation. 1970). 
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(hat received the largest share of Science Development funds— physics, 
chemistry, and mathematics— were analyzed in greatest detail, as was 
?he nonfunded control field of history. Finally, to define **quality science 
education" in American graduate schools, multiple indicators (i.e., mul- 
tiple criteria) were used. 
The major findings arc enumerated below. 

1. Faculty Size nsf funds helped departments in all three science 
fields to enlarge their faculties. }n physics and chemihfy this increase in 
faculty size was limited to the public sector. 

2. Faculty Mobility An analysis of senior faculty mobility in the field 
of physics showed that the funded institutions did not develop by 
recruiting extensively from the leading physics departments. 

3. Scholarly Productivity Science Development funding havi a posi- 
tive effect on scholarly productivity as measured by rates of publication 
in key journals, i.e., the funded departments registered an increase in the 
number of articles published b> their faculty members in journals that 
have high scholarly impact. This increase. However, was largely a 
function of the growth in faculty size; the effects on the publication rate 
of the individual faculty members were minima!. 

4. Graduate Student Enrollment and Quality Receipt of a grant was 
not closely related to increases in graduiUe student enrollments. Funded 
departments, however, were able to attract higher quality graduate 
students (as measured by an improvement in the scores of first-year 
graduate students on the Graduate Record Examination), though there 
was no change in the quality of gradijate stadents if one judges by the 
selectivity of their baccalaureate institutions, 

5. Ph D. Production Although Science Development fiinds in- 
creased the production of Ph D.'s in physics, in mathematics that effect 
was observed only in the public university sector. In chemistry, no 
impact at al! was apparent. 

6. Postdoitorate Employment Ph.D.'s from funded institutions dif- 
fered very little from Ph.D s from nontunded institutions with respect to 
attractiveness of jobs obtained upon graduation, whether in or outside of 
academe New Ph D.'s m mathematics I'rom private Science Development 
institutions were somewhat more successful than those from (private) con- 
trol institutions in obtaining positions at high-quality universities. 

7. Geo^r^iphical Distribution Under the major subprogram. Univer- 
sity Science Development imo). 31 universities in 21 states were 
funded. Six usd recipients were located in a state that already had at 
least one leading university according to a combined science measure 
based on the fields of mathematics chemistry, and physics. The other 25 
USD recipients were vlistrihuted amf)rig 17 states that did not have a 



leading university in l%5. Therefore, the goal of geographical dispersion 
of funds !svas largely achieved. 

i 
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Genesis and Objectives of Science Deverdpment 

The Science Development (so) program catne into existence as a result of 
several factors: (I) the realization on the part of the nation's leaders, 
including Presidents Eisenhower. Kennedy, and Johnson, that the 
number of high-quality graduate science education programs hud to be 
increased; (2) growing criticism voiced by congressmen and educators 
concerning the traditional patiem of federal acade>nic science assistance; 
and (3) the emergence of political pressure on the federal government 
and on the National Science Foundation to distribute federal science 
money along broader geographical lines. 

At the end of World War II the federal government began to fund 
academic science for the purpose of advancing knowledge and conduct- 
ing research related to specific national goals, such as nuclear energy 
development. The Soviet -American space race added impetus to fund- 
ing programs and. in the process, focused attentior^ on the nation's need 
for research. During this period, the larger research grants went to a 
small number of universities concentrated in a few states (particularly 
Massachusetts and California). Outstanding research scientists were in 
short supply and those available were employed by the few universities 
already noted for their research commitment, their excellent graduate 
programs, and a generous endowment or substantial state govr rnment 
support. For example, in 1963 the federal government distributed $1.3 
billion for academic science. Over $500 million— or 40 percent— went to 
17 schools, each receiving over $20 million. Not one of these well- 
funded institutions was located in the South, the Southwest, the Plains 
states, or the Rocky Mountain stales. Since research grants were 
awarded on the basis of peer review of both the project and the research 
potential of the principal investigator, it is hardly surprising that grants 
were most frequently awarded to outstanding research scholars at the 
most prestigious universities. 

At the same time, leaders in government and higher education were 
calling for an increase in the number of universities with strong graduate 
programs in the sciences. !n their view, the small group of leading 
universities could not provide the scientific base required to rapidly 
advance the nation's technologically oriented economic system. Accord- 



ing to the widely discussed Svahorg Report (1960), **The growth of 
science requires more phices with superior faculties and outstanding 
groups of stude.nts. Existing strong institutions cannot fully meet the 
nafion's future needs. jhe President's Science Advisory Committee, 
authors of the report, recommended that the existing imbalance be 
rectified, ''Over the next fifteen years the United States should seek to 
double the number of universities doing generally excellent work in basic 
res^-arch and graduate education. ""^ Since the gross national product had 
grown by a disappointing 34 percent during the 1950's, various means 
were sought to encourage greater economic growth and to distribute its 
benefits more widely. Creating additional outstanding research univer- 
sities was one such means. 

In the early 1%0's it was asserted as a matter of conventional wisdom 
that scientific research contributed to the economic growth of the 
community in which it was carried out. Advocates of this view pointed 
to the growth of the electronics industry and its close association with 
leading universities in the sciences (e.g., the development along Route 
128 near Boston and Cambridge), Understandably, many officials 
wanted to improve the quality of science education in their states in 
order to facilitate economic growth and attract new industry. These state 
leaders saw the major portion of federal science funds going to a handful 
of institutions in a few states and protested that, since all parts of the 
country pay federal taxes, all parts of the country should reap the 
benefits of fed'^ral expenditures. Demands were made on the federal 
government and on nsf to broaden the geographical dispersion of 
academic science funds. In response. President Johnson issued a proc- 
lamation directing all federal agencies that awarded research grants to 
consider the geographical distribution of the grants carefully. 

At present, one-half of the Federal expenditures for research go to 20 major institutions, 
most of which were strong before the advent of Federal research funds. During the period 
of increasing Federal support since World War II. the number of institutions carrying out 
research and providing advanced education has grown impressively Strong centers have 
developed in areas which were previously not well served. It \s a particular purpose of this 
policy to accelerate this beneficial trend since the funds are still concentrated in too few 
institutions m too few areas of the country We want to find excellence and build it up 
wherever it is found so thai creative centers of excellence may grow m every part of the 
Nation.* 



' Fie side nt's Science Advisory Committee. Scienttfu Pro)>ress. the Untversuies and the 
Federal Government (Washington. D. C The White House, November 1960). pp. 14-15. 
Ubid.. p. 28. 

* "Strengthening Academic Capability for Science." Statement by the President to the 
Cabinet. September 1.1. 196.S Weekly Compilation of Presidential Documents. Monday. 
September 20. 1965, pp. 267-268. 



NSF» which prior to l%0 had received scant attention from Congress, 
now had to come to grips with political realities in order to obtain its 
periodic authorizations and annual appropriations. In the name of scien- 
tific integrity, the agency could not be indifferent to political pressures; 
its response to these national needs was Science Development. 

The (SD) program's first objective was to augment the number of 
American universities with the capacity to do outstanding scientific 
research and with strong graduate curricula in science and engineering. 
About 20 universities in the United States already fulfilled these criteria. 
Policymakers wanted to double the number by moving a group of 
^^second-tier" science institutions into the ''top * category. 

To do so required simultaneous improvements in the components of 
graduate science education: graduate enrollments, the quality of first- 
year students* the caliber of graduating Ph.D,'s, faculty and research 
productivity, equipment, and facilities. Science Development's second 
major objective was to build up promising science institutions in regions 
and states that did not have an outstanding university, thus satisfying 
political demands for a broader dispersion of funds and, ideally^ creating 
"centers of excellence" in communities that would benefit both econom- 
ically and educatVnally. 

Structure and Implementation of the Program 

These goak wer6^new to nsf and so required new approaches. Tradi- 
tionally, support had gone to individual researchers to carry out specific 
studies, experiment^, or general lines of inquiry that would promote 
scientific knowledge oV improve the capability of a federal agency to carry 
out its mission: Any institutional change that might result from the funding 
was a by-product of the grant, albeit a desirable one. With Science De- 
velopment, however, nsf undertook to improve institutions rather than 
just to explore new realms of scientific knowledge and procedure. 

The Policy Model 

To implement this intention, nsf developed a new policy model for 
federal funding of graduate science education. The model was initially 
designed for what became known as the University Science Develop- 
ment (USD) program, although its features were later adapted to two 
other subprograms* Special Science Development (ssd) and Departmen- 
tal Science Development (dsd). Its parameters., which will be discussed 
in the following pages, are as follows: 

I. Broad national objectives 
H. Institutional planning required by proposal 
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III. Peer review of the proposal 

IV. Large influx of funds 
V. Flexible administration 



The broad national objectives of moving **good** universities toward 
excellence in science and distributing funds on a geographical basis have 
already been discussed. The other parameters of the modei and the 
subprograms under Science Development are discussed below. 

Institutional Planning Any universityj that wanted to be considered for 
a grant had to submit a detailed plan for the development of the 
sciences. The applicant institution was expected to indicate its needs 
with respect to personnel, graduate students, equipment, and facilities in 
those departments (typically four or five per institution) designated to 
receive the awards. As it turned out, the major portion of the money 
went to physics, chemistry, and mkhematics, but virtually all scientific 
and technical disciplines were funded. The program was unusual in that 
many activities could be carried out , under one grant. In its development 
plan, the university also had to demonstrate financial, organizational, 
and academic commitment to graduate science. Unlike matching grant 
programs, the sd program did not require that the school match federal 
money, dollar for dollar, with funds from other sources, but the institu- 
tion did have to show a willingness to provide additional revenues to the 
appropriate departments to preserve and extend the gains achieved 
under Science Development. 

NSF discouraged certain institutions from applying for grants. The 
agency did not fund schools already outstanding in the sciences, a group 
that in the early 1960*s was felt to comprise about 20 institutions 
(although NSF was careful never to identify the particular universities in 
the '*top 20**). In addition, schools whose potential for science develop- 
ment was obviously too weak (for instance, those that lacked graduate 
programs in the sciences) were precluded from consideration. Eligible 
institutions that initially submitted an inadequate proposal were, in some 
cases, encouraged to revise and resubmit the plan. Eventually, nsf 
accepted over 100 formal applications for Science Development grants. 

Peer Review The procedures adopted by nsf to determine the grant 
recipients were similar in some respects to those used prior to 1965 for 
awarding project grants. After the formal application had been reviewed, 
NSF selected a site visit team that included several staff members, two or 
three scientists from leading universities, and — an innovation in the 
procedure— <)ne or more persons experienced in university management 
who were expected to evaluate the administrative and financial potential 
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of the applicant institution. The site visit team reviewed the proposal, 
visited the institution* observed the science resources, and consulted 
with the facuhy and staff members involved in the proposal. Reports 
from the site visits, along with quantitative data, were reviewed by the 
NSF staff, which then prepared recommendations for discussion by top 
NSF officials, 

i4sF introduced a second innovation in its peer review-evaluation 
procedures. After visiting all campuses from which a formal proposal 
had been accepted, nsf invited university representatives from both 
successful and unsuccessful applicant universities to its headquarters in 
Washington, D,C- Foundation officials feU that the preparation of a 
development scheme called for an intensive effort on the part of the 
universities and that the meeting itself could be beneficial to the unsuc- 
cessful applicants. Representatives from the schools that had been 
turned down were able to discuss various features of their graduate 
programs with the nsf staff who then made recommendations for 
possible improvements. This strategy enabled the unsuccessful institu- 
tions to learn where they stood in comparison with other universities and 
what had to be accomplished in order to maintain and improve their 
graduate science programs. (It must be remembered that, in addition to 
selecting recipients on the basis of potential quality, a second criterion 
was to ensure geographical distribution of the grants,) 

Fundinu A total of $177 million was delivered to 31 institutions under 
the SD program over an 8-year period (1965-1972).5 Compared with the 
typical federal science project award, the individual grants were very 
large, ranging in value from about $2.3 to $9,2 million. The program did 
not begin to raise the recipient institutions to the financial level of the 
nation*s leading universities, however; nor was it intended to do so. 
Science Development funds served as seed money designed to have a 
catalytic effect; the dollars, wisely used, could lead to stronger depart- 
ments and hence to expanded financial support in the future, it was 
hoped that the program would spur the recipient institution to develop 
further plans, continue its recruitment of outstanding facuhy, and attract 
more and better graduate students. 

Despite the large size of the grants, they represented only a small 
portion of the total flow of federal science dollars to the recipient 
institutions. In I%5, the first year of the program, 20 of the funded 
schools received over $10 million each in science funds from all federal 
sources, and only 2 recipients received less than $6 million. Although 

^ Another S54 million was awarded under the two other Science Development programs. 
Departmental Science Development and Special Science Development. 

\ 
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the Science Development grants averaged $1 million per year per institu- 
tion, this amounted to less than 16 percent of the annual federal flow to 
academic science at all but 2 institutions, where it represented less than 
25 percent of the annual flow. Science Development funds had to have a 
powerful impact in comparison with other federal science money for the 
program to produce positive and permanent change among the recipients. 

The award periods were relatively short term. The initial grant period 
lasted 3 years, after which the recipients were eligible for a supple- 
mentary grant, afain large in value, that ran for 2 years. Thus, a re- 
cipient institution could participate in the program for 5 years, after 
which it became ineligible for further consideration. 

By the nature of the program, the potential recipients were limited in 
number, constituting only a small group in one part of the nation*s social 
structure. Targeting funds in this way enabled nsf to carry out an 
intensive evaluation of each proposal. The agency attempted to move a 
small group of institutions a long way rather than a large group a little 
way. 

Flexible Administration nsf adopted a flexible administrative posture 
in two respects. First, although the applicants* plans had to be limited to 
scientific and technical disciplines, each recipient institution had broad 
discretion in pursuing Science Development goals. For example, the 
University of Rochester used most of its award for the construction of a 
new chemistry and biology building. The University of Arizona used a 
sizable portion of its award for a new 90-in, reflector telescope. North 
Carolina State University distributed funds among engineering disci- 
plines, while its neighbor, the University of North Carolina, upgraded its 
composer facility and devoted funds to several social science disciplines,- 
In soir.e cases, nsf exercised a veto power over an applicant's develop- 
ment scheme by refusing to fund a particular department the site visitors 
considered too weak or by turning down part of a proposal for certain 
personnel additions, equipment purchases, etc. For the most part, how- 
ever, the applicant institution chose the disciplines to be funded and de- 
termined the best means for advancing its own academic science. The 
second aspect of nsf*s administrative flexibility was that, once awards 
were made, bureaucratic red tape was minimized. During the course of the 
grant, recipients were able to make modifications and adjustments in their 
plan without interference from the Foundation, ^ 

The Subprograms 

Early in the Science Development program nsf recognized that the 
initial program could not adequately meet all the particular circum- 
stances surrounding graduate education and established two additional 
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subprograms, which came to be designated Departmental Science De- 
velopment (DSD) and Special Science Development (ssd). Beginning in 
1966» NSF awarded $11.9 million to II institutions under the Special 
Science Development program. The grant period extended for 3 years 
with no provisions for supplementary funding* and with the awards 
based on the applicant institution's usd proposal. The National Science 
Foundation awarded ssd grants to institutions when it found that a 
portion of the applicant's plan desei-ved to be funded, but that the 
overall strength to warrant a full usd grant was insufficient. 

Beginning in 1%7, the agency awarded 73 grants under the dsd 
program totaling $41 million with an average grant of about $600,000. 
Under this program, individual departments were funded for a 3-year 
grant period. Unlike the usd subprogram, though, no department was 
eligible for supplementary funding. The dsd program was created as an 
alternative to the usd program for several reasons. 

First, some institutions had certain strong departments but lacked the 
overall potential in science to move toward excellence. The single 
department judged to have strength was recognized while the institution 
as a whole was not. Second, dsd grants were awarded according to the 
principle that specific science fields within institutions located in urban 
areas should be improved. Third, dsd funds were used lo encourage 
interdisciplinary studies. Fourth, after a year had passed since the 
previous award, an institution became eligible for another dsd grant, as 
long as its proposal covered a different department. As a result, several 
schools acquired dsd funds for two departments, and in one case three 
departments were funded in succession. (See the appendix for a li.st of 
grant recipients under each of the three subprograms.) 



The Evaluative Study 

This section, drawn largely from the technical report,^ first describes the 
method of evaluation; second, it discusses the findings with respeci to 
the Science Development program's impact— its direct effects on sci- 
ence quality and other more peripheral effects— on the recipient institu- 
tion; and finally, it considers the program's success in achieving the goal 
of geographical dispersion of funds to build up regional centers of 
excellence. 

* David B. Drew, Stienie Dewlopment. An EvaluiUion Study (Washington. D. C: Na- 
tional Academy of Sciences. 197.'^). The summary presented here is based pnmanly on 
Chapter 9. key tables and figures from other chapters in the technical report are also 
included. 
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METHODOLOGY 



The evaluation employed multiple indicators of quality— i.e., faculty 
size, doctorate production, etc.— to measure the recipient's achieve- 
ments under the program. The investigators hoped that, through this 
process, the study might contribute to a more sophisticated definition of 
quality in graduate education. One basic methodological problem was to 
design techniques for determining the impact of Science Development 
fundjf upon universities of varying size, programs, and budgets. A 
second methodological problem was to differentiate Science Develop- 
ment effects from the general development taking place in most univer- 
sities during the 1%0's. 

Essentially two techniques were employed: (1) a series of site visits to 
selected institutions to obtain information and impressions from univer- 
sity officials about the impact of the Science Development program, and 
(2) multivariate analyses of quantitative data for a large sample of 
universities with graduate science programs. From the two sets of 
data— -one qualitative and subjective, the other more quantitative and 
objective— it was hoped that some definite conclusions about the impact 
of the NSF program upon the recipient institutions might be inferred. 

Site Visits 

Twenty-one institutions were selected for the site visits: 16 recipient 
universities and 5 nonfunded institutions, included for purposes of 
comparison. Of the recipient institutions, 9 had received University 
Science Development grants, 6 had received one or more Department 
Science Development grants, and 1 had received a Special Science 
Development grant. The institutions were chosen to represent diverse 
characteristics: large and small, public and private, funded and not 
funded, and reportedly successful and not-so-successful in achieving the 
program's goals. In addition, because nsf emphasized geographical 
dispersion of funds, site visit teams went to institutions in all parts of the 
country. In terms of control (public or private) the institutions were 
distributed as follows: 



Type of 
Institution 



USD and Special Grant 
Applicants 



DSD Applicants 



Recipients Nonfunded Recipients 



Nonfunded 



Total 



Public 
Private 



13 
8 
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The teams visiting the tsn recipient institutions numbered four or five 
individuals: a senior member of the study staff, a member of the study 
panel, two or more scientists who were familiar with the funded disci- 
plines, and others specializing in university assessment or in academic 
administration. In the case of dsd recipients, the team consisted of a senior 
member of the study staff and a scientist who had been involved in the 
original nsf site visits to institutions applying for grants. 

During the visit, members of the team met with the institution's chief 
administrative officers, with those university officials who had been 
involved in the preparation and management of the gr nt proposals, and 
with academic deans. Faculty members and graduate students, from 
funded and nonfunded departments, were interviewed in depth to deter- 
mine the impact of the grant on the recipient departments and on 
nonrecipient departments that may have been aided or hindered by the 
funding. 

Quantitative Analysis 

If the quantitative analyses were to be meaningful, it was necessary to 
identify trends already under way at the time the nsf grants were made 
(chiefly 1965-1967) and to look at the concluding years of the program 
(1971-1972).^ For this reason, the study utilized data extending over the 
15-year period, 1958-1972, whenever possible. In addition to longitudi- 
nal data, a variety of statistical techniques were employed to isolate the 
unique effects of Science Development grants,. 

As is customary in this kind of analysis, a group of control institutions 
were specified and trends were also examined within that group. To 
make the comparisons as complete and as illuminating as possible, every 
major doctorate-awarding institution in the United States was included 
in the control group. The selection was made by consulting An Assess- 
ment of Quality in Graduate Education by Allan M. Cartter'* and A 
Rating of Graduate Fro^ranis by Kenneth D. Roose and Charles J. 
Andersen,** two assessments of graduate education that covered all 
major universities at the time they were conducted. The Cartter survey 
was made in 1964, one year before the program began to distribute 
funds, and served as the basis for defining the control groups. Data were 
collected on all universities included in the l%9 Roose-Andersen sur- 
vey to ensure that information would be available for the largest sample 
of major universities. 

' More recent data were not available 

" Allan M Cartter. 4/i Asscssnufit of QtuiUn m Ciradtuitt tJumtum (Washington, 1) C 

American Council on Hducation. 

* Kenneth 1) Roose and Charles J Andersen, op nt 
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The nonfunded institutions were subdivided into ihree categories: the 
"high controls/* the "medium controls'' and the 'low controls." The 
second category, "medium controls/' comes closest to fulfilling the 
classic definition of a control group. The control groups included institu- 
tions whose proposals were rejected and institutions who never applied 
for a grant. Each school was categorized according to the following 
procedure. The high>control group included the universities that re- 
ceived a rating in the Cartter survey above the score of the most highly 
rated usd recipient in that field. This group contains those institutions 
generally recognized as outstanding in science that were ineligible for 
USD grants. The medium control group included those schools rated in 
the same range as the recipients, or institutions roughly similar in quality 
to USD schools prior to funding. The low control group comprised the 
universities that were rated below the lowest recipient departments in 
the Cartter survey, or those institutions whose science capabilities were 
found by their peers to be weaker than the Science Development 
recipients. Suppose, for example. 25 usd recipients in physics were all 
rated between 2.00 and 3.00 on the Cartter scale. Then the high controls 
would be the universities with a rating of 3.01 or better, the medium 
controls would be all nonfunded schools with a rating between 2.^X) and 
3.00. and the low controls would be those universities with a rating 
below 2.00. This procedure allowed the control groups to be defined in a 
consistent and objective fashion for each field. At the same time, by 
collecting data for a 15-year period, it was possible to determine whether 
NSF funded only the universities that were already showing signs of rapid 
expansion. (The investigators found that this did not occur; in part, of 
course, because recipients were chosen according to their geographical 
location as well as the quality of their graduate science program.) 

Comparisons were restricted to the scientific disciplines of mathema- 
tics, physics, and chemistry, the three fields that received the majority 
of Science Development funds. Tweniy-eight usd institutions received 
grants in at least one of these three fields. As a further control, a field 
not included in the program, history, was also used in the analysis. 

Partly because of limitations on the availability of data, the analyses 
were restricted to six criteria. The variables considered to be measures 
of quality were: 

Faculty size 

Faculty publication rates 
Graduate student enrollments 
Graduate student quality 
Ph.D. production 
Post-Ph.D. employment 
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EFFECTS OF SQENCE DEVELOPMENT ON QUALITY 

Science Development grants did produce positive changes in the quality 
of graduate education in the funded departments, as measured by the six 
criteria listcc^ above. Thes^ changes were not uniform, however: some 
institutions advanced more than others. In addition, most recipients 
showed the greatest g^^- on those indices related to the research 
function of science departments, e.g., faculty size and publications. The 
recipients also realized some gains in the measures directly related to the 
educational function of graduate science, e.g., Ph.D. production, but 
these changes were not extensive. 

Faculty Size and Mobility 

Faculty sizes were compared at Science Development institutions and at 
control institutions between 1958 and 1970 (Tables U4), using data from 
the American Council on Education's quadrennially published Am^'r/caw 
Universities aniT'^t^ie^'es. All five groups of institutions registered 
increases in faculty size in all three fields, though not in the control field, 
history. (The reader is reminded that the most pertinent comparisons are 
those between usd recipients and medium controls.) Further inspection 
of the data revealed that this substantial growth at funded institutions 
was manifested chiefly in the public sector. For example, the faculty size 
in mathematics departments at the public recipient institutions increased 
from an average of 22.0 in 1958 to 50.6 in 1970, whereas at the private 
recipient institutions mathematics faculties increased from 18.0 to 29.7 in 
this same period. 

A ficld-by-field comparison revealed some interesting patterns. In the 
mathematics departments at public and private institutions, the USD 
recipients had smaller faculties than the medium control institutions 
before funding and larger faculties after funding, although the change 
was greater at the public institutions. In the physics departments, 
however, the trends in faculty growth at public and private institutions 
diverged. The public usd recipients began with smaller faculties than the 
medium controls (18.1 vs.* 25.3) and by 1970 the situation had been 
reversed; the usd faculties exceeded the aiedium controls in size (42.9 
vs. 35.4). On the other hand, in the private institutions (where once 
again, the departments tended to be smaller) the usd recipients began 
with larger physics faculties than the medium controls and retained this 
advantage, but the gap grew smaller.. Again, in chemistry the public usd 
recipients began with smaller faculties than the public medium controls 
(18.9 vs. 23.4) and ended with larger faculties (35.7 vs. 31.5), although 
the change was less pronounced than the one found in mathematics and 
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TABLE 1 DtpartmenUl Facufty Sizes in Science Development and Control Institu* 
tiont: Mathematics 





No. 


1958 


l%2 


1966 


1970 


All Institutions ^ 












USD recipients 


15 


20 ; 


24,3 


37.8 


42.2 


1)80 recipients 


5 


13.4 


14.2 


22.4 


33.4 


High controls 


17 


30 4 


35.9 


52.7 - 


50.9 


Medium controls 


15 


24.2 


?6 9 


37.2 


35.7 


Low controls 


16 


14 0 


17.9 


23 2 


28.8 


Public Institutions 


• 










USD recipients.. 


9 


22.0 


27 9 


44.3 


50 6 


OSD recipients 


2 


17.5 


18.0 


25.0 


43 5 


High controls 


6 


.^6.8 


47 7 


78.2 


74.2 


Medium controls 


8 


28 6 


32 1 


44.4 


43.9 


Low controls — ' 


" 10 


19.0 


22.7 


'29.7 


37,9 


Pnvate Institutions 












USD recipients 


6 


18.0 


18,8 


28,0 


29.7 


DSD recipients 


3 


10,7 


• 11.7 ' 


20.7 


26 7 


High controls 


It 


25 6 


27 1 


33.6 


33.4 


Medium controls 


7 


19.1 


21 u 


29 0' 


26,4 


Low controls 


6 


5 7 


^0 0 


12.3 


13,7 


TABLE 2 Departmental FacuKy Sizes in Science Development and Control Institu- 


tions: Physics 














No. 


1958 


l%2 


1966 


1970 


All Institutions 












USD recipients 


25 


17.6 


23.3 


53.0 


37.4 


DSD recipients 


9 


93 


12.7 


17.7 


24.1 


High controls 


14 


33 8 


39.4 


45.3 


48.9 


Medium controls 


18 


19.4 


21.9 


28.3 


29.7 


Low controls 


19 


9.8 


11 6 


15.8 


19.1 


Public Institutions 












USD recipients 


16 


18 1 


24.3 


36.3 


42.9 


DSD recipients 


6 


9.2 


12.2 


17.5 


27.0 


High controls 


4 


' 31.3 


M.S 


46.0 


53.3 


Medium controls 


8 


25.3 


27 6 


.34.4 . 


.35.4 


Low controls 


13 


11. 1 


13.5 


18.6 


* 22.6 


Pnvate Institutions 










4 


USD recipients 


9 


16.6 


21.6 


27.2 


27.8 


DSD recipients 


3 


9.7 


13.7 


18.0 , 


18.3 


High controls 


to 


35.3 


40 4 


45 0 


46.8 


Medium controls 


to 


14.7 


17 3 


23 5 ' 


25.1 


Low controls 


6 


6.7 


7.3 


9.7 


11.3 
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TABLE 3 Departmental Faculty Sizes in Science Development and Control Institu- 
tions: Chemistry 





No 


1958 


l%2 


1966 


1970 


All Institutions 












LSI) recipients 


22 


180 


20.4 


26 5 


31 3 


t)SD recipients 


12 


16,2 


16 ^ 


18.8 


24 7 


High controK 


15 


27 4 


28 9 


.32 6 


.35.3 


Medium controls 


17 


21 7 


23.7 


26.9 


29.4 


Low controls 


24 


M 9 


13 4 


1*5.8 


18.0 


Puhhc Institutions 












LSI) recipients 


13 


18.9 


21 6 


"«0.0 


35 7 


osi) recipients 


K 


18.9 


18.3 


21 1 


29.0 


rligh controls 


5 


35 0 


^5.8 


40.J 


46.6 


Medium controls 


13 


23 4 


25.2 


28 8 


31.5 


I ow control^ 


13 


13 5 


14-9 


1-7.8 


21 5 


Private Institutions 












I sj) recipients 


' 9 


16.8 


18 6 


21 4 


24.9 


Dsi) recipients 


4 


10 8 


12.3 


14 0 


16 0 


High controls 


10 


22 0 


24 5 


27.8 


27.1 


Medium ^.ontro'v 


4 


16 0 


18.5 , 


20 8 


22.8 


l.oNv controls 


11 


U) I 


11.6 y 


13 4 


13.9 


TABLE 4 Departmental Faculty Sizes in Science Development and Control Institu- 


tions: History 














No 


1958 


l%2 


1966 


1970 


AU Insntutions 












USD recipients 


24 


15.5 


18.4 


24.4 


27.7 


High controls 


14 


28.3 


-32.4 


41 3 


39.8 


Medium ropirols 


IK 


14.3 


17 7 


22.9 


26.7 


Low controls 


18 


9.8 


12.2 


16.8 


20.3 


Public Institutions 












jst) recipients 


14 


16.2 


19 5 


27 4 


32.2 


High controls 


4 


27.5 


-30.8 


49.8 


.54 3 


Medium controls 


10 


17.8 


21.5 


29 1 


33.8 


l-ow controls 


9 


8.4 


9.9 


167 


21 4 


PnvaJe Institutions 












ts„ ccipients 


10 


14 6 


16.8 


20 2 


21.3 


High controls 


10 


28 8 


-33.3 


37.1 


31.6 


Medium controls 


K 


to.o 


12.9 


15 1 


17 9 


Low controls 


9 


II 2 


14.6 


170 


19.2 
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physics; in the private sector the recipient chemistry deparlments and 
the medium controls began with very simihir faculty sizes (16,8 vs, 16.0) 
and remained that way until )970» wheri the usD faculties were slightly 
larger (24.9 vs, 22,8), A multivariate analysis based on a linear model 
confirmed that Science Development funds had a significant positive 
elfect on faculty sizes in the science departments of recipient 
mstitutionsJ'^ 

Obviously* no grants were given to departments of history, the control 
field, but for purposes of analysis, data on all usD recipients with 
doctoral-granting history departments are shown in Table 4, along with 
data on history departments at the control institutions. Note that, with 
respect to history faculties, the recipient schools and the control insjtitu- 
tions retained their relative position throughout the time period, a finding 
confirmed by the multivariate analysis. 

One debate surrouliding the Science Development program concerns 
its effect 9n facuhy mobility in hi^^her education. If funds were used to 
**rob** the leading institutions of their top science talent, then it would 
not be clear that the nation as a whole had benefited. Instead, the 
program would simply have supported the movement of scholars from 
one section of the academic world to another, with no apparent national 
gain in science quality, A special analysis of faculty mobility in physics 
(the most heavily funded field) was conducted to test the program*s 
impact on faculty recruitment at usD recipient and medium control 
institutions. 

The basic research design was as follows: A study was made of the 
last institution of the senior faculty members who joined the facuhie^ of 
USD institutions during the period 1965^1971. These patterns v^ere 
compared with the patterns of senior facuhy members who took posi- 
tions at the medium control institutions during the same period. Finally, 
as a further control, the analysis was repeated for the period 1959-1965. 

The findings for physics did not support the charge that the usD 
recipient institutions developed by extensive recniiting of talent from the 

*®Thc multivariate analysis incorporated the following procedures. A number of dimen- 
sions representing prefunding departmental factors likely to affect subsequent faculty size 
were used as the independent vanables in a senes of multiple regression equations. These 
vanables were systematically regressed on faculty size for each year from 1965 through 
1972. Residual scores (actual minus predicted size) were then calculated Finally, the mean 
residual scores were aggregated for each group of institutions and the group means 
compared for each year from I%5 through 1972. 

Use of this linear model made it possible to predict faculty size in each school for each 
year on the basis of all key factors but Science Development funding. Differences in the 
predictive efficacy of the model between expenmental and control groups (as measured by 
the gap between predicted rates and actuaf faculty size) were taken to indicate that the 
funding had an impact. 
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leading institutions, or from any other group of institutions. Prior to 
funding, the Science Development and medium control schools had been 
acquiring new senior faculty from leading universities at about the same 
rate. After funding, the recipient institutions continued at the same rate 
while the controls slowed down. It is clear that Science Dev-lopment 
funds allowed the recipients to maintain the pace set between 1959 and 
l%5 without any substantfal changes in the academic sources of the new 
senior faculty. Moreover, the postfunding advantage of the Science 
Development funded schools (over the controls) was limited entirely to 
the publicly supported universities. 

Given the large size of physics departments in leading institutions, the 
movement on the part of faculty members to Science Development 
schools in either time period was not great. During the prefunding period 
(1959-1965) the USD recipient institutions recruited a total of 40 senior 
faculty members from the 14 high control institutions, and in the period 
after funding (1965-1971) they acquired a total of 57 senior faculty 
members from the high control institutions; thi;> represents an increased 
loss of about one faculty member per leading university over a 6-year 
period. 

Faculty Publication Rates 

One crucial measure of a university's science capabilities is the research 
productivity of its faculty, particularly their rate of pyblication in leading 
journals. Measuring that rate called for rather elaborate procedures. 

The leading journals in physics, chemistry, mathematics, and the 
control field of history were rank-ordered on the basis of an impact 
factor: * * the ratio of citations to a given journal (in other journals) divided 
by the number of source articles appearing in that journal. The journal at the 
top of the list, then, was the one whose articles were assumed to have 
had the greatest impact in that other scientists had cited them frequently 
in their work. In the ranking process, various technical adjustments were 
made for such factors as the representation of American authors in 
English-language journals published in other countries. The list for each 
field was limited to approximately 20leading journals, but these journals ac- 
counted for a majority of the citations in each field. In physics, for 
example, the 20 journals represented over 75 percent of all citations. 

Figures 1-4 show the rate of publication in these journals by faculty 
mornbers in usD-funded and in medium control institutions over the 

15-yea.- period 1958-1972. In examining these graphs, the reader should 

\ 

" Impact factor is \akcn from the Journal Citation Reports, published by the Institute for 
Scientific Information. Inc.. Philadelphia. Pa 
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FIGURE 1 Departmental publication rates in science development and control in- 
stitutions: mathematics. 



80,- 



z 

UJ 

GC 
< 



GC 
UJ 
Q. 
CO 

Z 

o 
< 

00 
D 

Q. 




FIGURE 2 OepartmenUl publication rates in science development and control in- 
stHutions: physics. 
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FIGURE 3 Departmental publication rates in science development and control in* 
stitutiont: chemistry. 
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FIGURE 4 Departmental publication rates in science development and control in- 
stitutions: history. 
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bear in mind the time lags involved* Although the Science Development 
program was launched in I965» many institutions did not receive funds 
until |%7 or 1968. Time was needed for the department to hire new 
faculty, for the faculty to produce papers based on their research, and 
for the journals to review and publish those papers. Considering all these 
factors in combination* one would expect to see the initial effects of 
Science Development funding reflected in publication rates no earlier 
than 1968-1970. 

Figures 1-3 are indicative of the rapid expansion in academic scien- 
tific research during the I960's. Publication rates in all three science 
fields* particularly physics, sharply increased over the 15-year period, 
while the publication rates in history (Figure 4) remained about the 
same. 

NSF funding had a positive impact on departmental productivity in 
mathematics, physics, and chemistry. In chemistry, this effect was 
revealed only through the multivariate analysis, but in mathematics and 
physics it was clear from the descriptive analysis. The most dramatic 
effect can be seen in the increase in 1968 (Sf the publication rate of 
mathematics departments in usd schools over that of mathematics depart- 
ments in medium control schools (Figure I). In physics (Figure 2), where 
the publication rate s in general were higher than in mathematics or chemis- 
try, the USD recipients remained about equal to the medium control 
group until 1970 when they began to surpass them by widening margins. 
Comparing usd and medium control publication rates in chemistry 
(Figure 3), virtually no effects were obvious on inspection, but the more 
sophisticated statistical techniques revealed a positive, albeit small, 
impact. The multivariate analysis substantiated the changes in mathe- 
matics and physics described above. 

During the period 1958-1972, research productivity as measured by 
the number of journal publications in the control field of history was far 
below that in the three science fields. Publication rates in the USD and 
medium control history departments did not exhibit a consistent trend. 
The improvements found in the three recipient science departnjents were 
not matched by increases in the usd university history department,s. 

The publication rate was also examined on a per-person basis to 
determine whether the changes resulted from larger faculties or greater 
individual productivity. Although the data for mathematics indicated an 
increaseyin the publication rates of individual faculty members, the 
multivariate analysis suggested this change was a result of other factors. 
Conversely, the multivariate analysis suggested a possible impact in 
chemistry, although the descriptive data revealed no effects of funding 
on per person productivity in either chemistry or physics. 
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Graduate Student Enrollments 



One key question relating to the success of the program is whether it 
helped to attract more and better graduate students to the funded 
departments. Several analyses were conducted to determine the impact 
of the program on both the quantity and quality of graduate students; the 
results are reported in this section and the next. 

Data on first-year* full-time enrollments and on total graduate enroll- 
ments (full-lime and part-time) were assembled and compared for Sci- 
ence Development and control institutions. Figures 5-8 plot the trends 
in total graduate enrollments in the three science fields and in history at 
the USD and medium control institutions. Figures 9-12 plot the same 
trends for first-year graduate enrollments. In all four fields, total 
graduate enrollments grew more or less steadily from 1959 to 1967 or 
1968» and then declined. 

The receipt of a Science Development grant had very little effect 
either on total graduate enrollments or on first-year» full-time graduate 
enrollments. The usd schools had consistently higher total enrollments 
in physics and history and consistently lower enrollments in chemistry 
and mathematics (except 1970). One exception was found among public 
recipient institutions, where graduate enrollments in usd mathematics 
departments increased in comparison with the medium control schools. 

Graduate Student Quality 

lurningfrom quantitative to qualitative considerations, the next analysis 
examined changes in a measure of graduate student ability: the scores of 
entering students on the Graduate Record Examination. Through a 
special retrieval effort it was possible to obtain the mean scores per 
department of graduate students entering chemistry and history depart- 
ments in a prefunding year (1964) and a postfunding year (1973). Exami- 
nation of these data indicated that the relative standing of graduate 
students enrolled in Science Development departments improved sig- 
nificantly in comparison to the medium cantrol institutions during the 
time period. Graduate students entering recipient chemistry departments 
scored below students entering medium control chemistry departments 
pnor to funding and above them subsequent to funding; this reversal was 
taie for both the verbal and the quantitative components of the ore. 
However, findings from the control field, history, suggest that the 
changes in the quantitative component of the test might be the result of 
factors other than nsf funding. 
As another measure of the quality of graduate students, the bac- 
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FIGURE 5 Departmental •nrotlmants in sdanca development and control inttitutiont 
(all graduate students): mathematics. 
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FIGURE 6 Departmental enrollments in sdence development and control institu- 
tions (all graduate students): physics. 
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FIGURE 7 DepartmtnttI enrollments in science develoment and control institutions 
(all graduate students): chemistry. ^ 
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FIGURE 8 Departmental enrollments in science development and control institu- 
tions (all graduate students): history. ^ 
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FIGURE 11 Oepartmenul enrollment* In science development and control institu- 
tions (first-year, full-time graduate students only): chemistry. 
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FIGlj^E 12 Departmental enrollments in science development and control institu- 
tions (first-year, full-time graduate students only): history. 
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calaurcate origins of students entering funded and control graduate 
departments were examined. Specifically, the investigators wanted to 
see If the graduate students attracted to the recipient departments after 
funding tended to come from more highly selective undergraduate in- 
stitutions. No such trend was found. 



Doctorate Production 

One problem facing graduate education today is the declining labor 
market for Ph.D/s in several fields. A special set of analyses was 
devoted to examining the effects of Science" Development funding on 
Ph.D. production and to tracing the subsequent employment of Ph D 's 
from recipient and control institutions. • 

Using data derived from the Doctorate Record File (drf) of the 
National Research Council, the average departmental Ph.D. production 
ot funded and control institution*, was plotted from 1958 to 1972 Figures 
13-16 show these trends for usd recipients and medium control'schools ^ 
In chemistry (Figure 15), the usd recipients were consistently behind the 
medium control schools throughout the 15-year period. Although the funds 
had a positive impact on doctorate production in the recipient mathemat- 
ics departments at public schools, the overall trend at usd and medium 
control institutions was mixed (Figure 13). In physics, the usd schools 
increased their Ph.D. production in comparison to the medium controls 
(Hgure 14). The multivariate analysis substantiated these findings. 

Post-Ph,D, Employment 

The rate of Ph.D. production is a quantitative measure. In ({r<^er to 
assess the changes in quality among new Ph.D.'s. data from tW^SF 
National Register and the drf were used to compare the first jobs\«en 
by Ph.D.'s from recipient and control institutions, doing separate 
analyses for those entering academia and those taking nonacademic 
positions. 

Figures 17-19 plot the average *aculty quality rating (based on the 
196+<artter survey) in department's at which graduates of usd and 
medium control institutions took their first jobs. The quality of fte'N 
institution- at which a Ph.D. took a first teaching job dropped over time 
for both groups. But this was less true for usd mathematics departments 
at pnvate institutions. In physics and chemistry, Ph.D's from usd 
and niedium control schools fared about the same in the postfunding years 
For those Ph.D.'s who took nonacademic positions, average starting sal- 
aries (the only available indicator) for graduates of funded and nonfunded 
institutions were compared. The starting salaries for graduating Ph.D.'s 
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FIGURE 13 Doctorate production in science development end control institutions: 
mathemetics. 
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FIGURE 14 ^Doctorate production in science development and control institutions: 
physics. 
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KIGURE 15 Doctorate production in science development and control institutions- 
chemistry. 
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FIGURE 16 Doctorate production in sdence.devetopment and control institutions: 
history. - 
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RGURE 17 Average Cartter rating of academic departments at which graduates of 
science development and control institutions took their first job: 
mathematics. 
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RGURE 19 Average Cartter rating of academic departments at which graduates of 
science development and control institutions took their first job: 
chemistry. 



from USD recipient departments and medium control schools rose at .about 
the same rate. ' 



OTHER EFFECTS OF SCIENCE DEVELOPMENT 

In addition to the Science Development program's impact on the various 
measures of departmental quality, the more indirect effects of the 
program were also examined. These effects were not subject to quantita- 
tive analysis, but were instead based on information and observations 
from the site visits. One question investigated during the site visits was: 
Did the funded departments expand and improve at the expense of 
nonfunded departments? At a few institutions there was evidence of an 
uneven rate of development as a result of the funding, but this disparity 
reflected conscious and deliberate choices made by the central adminis- 
trative officers at the institution. Generally, however, the site visitors 
found that funded institutions did not appear to have experienced major 
distortions in their programs, chiefly because the institutions took pre- 
cautionary steps to prevent such imbalances. 
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A second issue investigated by the site visitors was: Were the reci- 
pient institutions able to absorb and continue the gains realized under 
the program? The data needed to examine the impact of Science De- 
velopment on overall institutional budgets were not available. However, 
site visit reports indicated that some recipient institutions had given 
more careful consideration to the financial planning necessary for an 
effective program of institutional development than others. Despite the 
slowdown in the growth rate of federal research funding with its adverse 
financial impact on all research-oriented institutions, the recipients that 
planned more carefully maintained the improvements made under the 
program and continued to progress. 

Quantitative data were available on trends in overall federal aid to 
academic science for the period 1963-1972, Table 5 and Figure 20 show 
the total federal science support per university for each of two groups: 
the 31 USD recipients and a control group of comparable institutions 
(based on the combined science rating in mathehiatics. physics, and 
chemistry). As the table shows, although the usD/ferants were very large 
in comparison with other federal science awards, they represented a 
small portion of the federal science flow to the recipients. The usd 
schools received slightly larger amounts of federal assistance from 1964 
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to 1972, but the grants themselves were partly responsible for the 
differences between !%5 and 1971. 



Geographical Distribution of Funds 

The Science Development program was created in part to disperse 
federal science funds among states and regions that lacked leading 
science research institutions. To determine its effectiveness in achieving 
this goal, the geographical location of the nation's outstanding univer- 
sities in !%5was compared to the location of the USD recipient institu- 
tions. The leading universities were identified on thb basis of a combined 
science rating (for the departments of mathematics, physics, and chemis- 
try) derived from Cartter's 1964 survey. Fifteen institutions, distributed 
among nine states, clearly stood out as ^'centers of excellence," accord- 
ing to the Cartter ratings. Under the USD subprogram, nsf funded 3! 
universities in 2! states. Six usD recipients were located in a state that 
already had at least one leading university. The other 25 usD recipients 
were distributed among 17 states that did not have a leading university in 
1%5. 

A fundamental problem here is that the program's two major goals- 
dispersing funds on a geographical basis and developing promising 
institutions into outstanding ones— are not entirely compatible. The 
eligible institutions— i.e., the ^^second tier" of research universities- 
were not distributed uniformly throughout the country but tended to 
cluster in certain areas. Figure 2! is a map ot the United States 
indicating the location of the 15 leading universities and 50 universities 
that would clearly be considered eligible for Science Development grants 
at the time of the program's inception;*^ Figure 22 shows the location of 
the recipient usd institutions. An examination of the location of the funded 
institutions indicates that the goal of geographical dispersion was achieved. 

Finally, the grants satisfied geographical considerations in one other 
way. Table 6 lists the states, grouped according to the four principal 
Census Bureau regions, and indicates the numbers of leading institutions 
and USD recipients. Note that the leading universities are almost evenly 
divided among the northeast, central, and western sections of the 
country. The South, which in 1%5 had no leading science institutions as 
defined here, was the chief beneficiary. Thirteen schools located in that 
region received uso funds. Looking at the figures in another way, the 
Northeast, with 24 percent of the' nation's population in 1970, had 19 

^^EU^ihie unnersifies were identified m terms of the combined science rating (physics, 
chemistry, and mathematics) derived from the Carlter study. 
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6 Geographical Distribution of Leading Universities and of uso Recipients by 
Region and State 



Region and State Universities 



No, of Leading No. of USD 



Northeast 

Maine \ q 

New Hampshire 0 

Vermont 0 

Massachusetts 2 

Rhode Island 0 

Connecticut \ 

New York 2 

New Jersey I 

Pennsylvania 0 

TOTAI 5 

South 

Maryland 0 

West Virginia 0 

Distnct of Columbia 0 

Virginia 0 

Kentucky 0 



Central 
Ohio 
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North Carolina 0 
Tennessee 

South Carolina 0 

Georgia 0 

Florida q 

Alabama 0 

Mississippi 0 

Arkansas q 

Louisiana q 

Oklahoma q 

Texas q 

roTAi n 



Michigan I 
Indiana 0 
Illinois 
Wisconsin 
Minnesota 
Iowa 



Missouri 0 

North Dakota 0 

South Dakota 0 

Nebraska 0 

Kansas 0 

TorAL 5- 
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TABLE B^ontinu0d) 



No, of Leading \ No, of uSD 

Region and State Universities Recipients 





West 



Montana 


0 


\ 0 


Wyoming 


A 

u 


\o 


Colorado 


u 


Y 


New Mexico 


0 


o' 


Idaho 


0 


0 


Utah 


0 


0 


Arizona 


0 


1 


Nevada 


0 


0 


Washington 


0 


1 


Oregon 


0 


1 


California 


4 


1 


Alaska 


0 


0 


Hawaii 


0 


0 


rOFAl 


4 


5 



Population. 1970 Census, in millions: 
Northeast 48,9 
South 62,1 
Central 56,6 
West 34,9 



percent of the grant recipients; the South, with 30 percent of the 
population, had 42 percent of the grant recipients; the central states, 
with 28 percent of the population, had 23 percent of the recipients; and 
the West, with 17 percent of the population, had 16 percent of the 
recipient institutions. Given these population figures, the Northeast had 
fewer funded institutions, but it also had more leading universities to 
start with; the South had the largest proportion of funded institutions, 
but it had no leading science university as defined here in 1%5; the 
central region also had relatively few funded institutions but it began 
with one-third of the leading universities; and the West had virtually the 
same proportion of the population and grant recipients. In short, the 
program reached a substantial number of universities located in states 
and regions that were not already occupied by a leading science institu^ 
tion. 

Although several states receivec/ usd grants in more than one institu- 
tion (three in Indiana, three in New York, and two in Pennsylvania), the 
Science Development program, to a considerable extent, achieved its 
explicit goal of dispersing federal science money to sections of the 
country that previously had been ^'disadvantaged'' in this respect. 
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Concluding Observations 



Several questions can be addressed in evaluating a new or **experimen- 
tal" pro^m. Did the funds delivered in this form produce positive 
changes bf the type expected in the recipient institutions? Did the money 
distributed through the program have a greater impact than it would 
have had using traditional funding mechanisms? Did the program suc- 
cessfully pursue public policy goals that could not have been achieved 
through existing mechanisms? Were the gains worth the costs? 

The quantitative analyses and site visit reports show that the Science 
Development program was responsible for many positive changes at the 
recipient institutions. The funds enabled the universities to support 
additional faculty members and had a definite positive effect on the 
research capacity of the funded institutions. Although graduate enroll- 
ments in the funded universities did not increase relative to the medium 
control institutions, the quality of first- year students as measured by gre 
scores did improve in the funded departments relative to the controls. 
With Science Development money, recipient institutions were able to 
create new programs and to reorganize current endeavors. This report 
has not directly concerned itself with the changes in equipment and 
facilities brought about by the program, but the site visitors found 
numerous improvements in ih^se areas. The positive eflfects of the 
program on research productivity, of course, are further testimony to the 
improvement in equipment and facilities, as well as in personnel. 

The evaluation study did not have the resources to analyze traditional 
funding programs, and sufficient evidence from other sources does not 
exist to allow rigorous comparisons of the effects of Science Development 
funding with those of project awards or contract support. The data 
available on total federal science assistance show that, even during the 
period of SD awards, usd institutions received only slightly more total 
federal support annually than did the medium control schools. Yet, the 
evaluation study has shown that this small annual increment in total 
federal assistance was associated with some rather large changes in 
quality. That fact, in itself, speaks well for institutional support as a 
funding mechanism. 

Furthermore, it must be remembered that the immediate goals of the 
Science Development program differed from that of research project 
grants and contracts. The goal of this program was to create outstanding 
science programs in universities throughout the United States, while the 
goal of research project grants is to increase knowledge through 
individual research efforts. As part of a research project, equipment 
purchases are often made, graduate students may obtain financial assis- 
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tance, and faculty members may receive support* but these activities are 
not part of a systematic development plan for the institution. The 
Science Development funds* however* did serve a catalytic function for 
a sizable number of recipients and enabled them to accelerate the 
development of their science capabilities. The program did not create 
**centers of excellence** in the sense that every funded institution is now 
the academic peer of the nation*s top universities, but notable improve- 
ments did occur in many of the USD schools. 

Project support contributes little to the permanent strength of the 
university. A faculty member may receive several million dollars to 
conduct scholarly research at a university, but, should he or she depart 
during the work or after it is completed, the permanent contribution to 
the school will be limited. The goal of institutional support, on the other 
hand, is enduring improvement in quality. The evaluation indicates that 
this goal has been met with respect to some clear-cut measures of 
quality. A fear expressed in some quarters about institutional support 
was that this federal money would pimply be absorbed into a schooPs 
budget without yielding discernible effects. The study has indicated that 
this fear was not justified. 

The second major objective of the program, geographic dispersion of 
centers of science excellence, was largely achieved. Certainly the south- 
em region of the United States benefited considerably from the program* 
and, in the West, centers of excellence outside of California began to 
appear. Moreover, it seems evident that greater equality in the distribu- 
tion of top science research personnel throughout the various regions 
occurred as a result of the program. It must be concluded that one 
consequence of the Science Development program was a wider geo- 
graphical dispersion of science research personnel and resources in the 
United States. 

The site visit reports, as well as the statistical analyses, indicated that 
certain recipients made greater progress than others. One key factor that 
distinguished successful from less successful grants was the strength of 
an institution's central administration, particulariy its president or chan- 
cellor. That person's continuity in office was particulariy important. 
Grants tended to be most successful at universities that had a strong, 
dynamic leader who was in office before* during, and after the grant. An 
equally important factor— and one closely associated with a strong 
central administration— was the existence of a detailed development plan 
for the total institution. Such plans often served as the basis for a 
Science Development proposal, which then was likely to contribute to 
balanced overall growth within the university. 

The capacity to obtain further funding from other sources was another 
characteristic common to the more successful recipients. Like most 
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federal programs for higher education (other than those based upon the 
Morrill Act of I862)» Science Development made no distinctions be- 
tween public and private institutions. Yet» the program was an exercise in 
institution building. Apart from federal government grants for project 
research and for other special purposes* slate universities are dependent 
upon state legislatures and student fees for their primary sources of' 
income* while private universities are dependent upon student fc6s and 
philanthropy for income. The state universities that made the most gains 
from Science Development grants were those thai obtained continuing 
and enlarged state govemtnent support. The private universities that 
made the most gains were those that obtained substantial additional 
financial assistance from philanthropy. These circumstances, along with 
the slowdown in the rate of increase in federal government support of 
project research* contributed significantly to the success or nonsuccess 
of the Science Development program in institutional terms. 

During the I960*s and eariy I970*s, there was some criticism that the 
Science Development program did not seek to maintain a reasonable 
balance between research and instruction. The site visitors did report 
some instances of imbalance between research and instruction* between 
the sciences and the arts* and between the sciences and professional 
fields of study* but this imbalance could not properiy be laid at the door 
of either the federal government or the National Science Foundation. 
The maintenance of internal balance is a responsibility of university 
leadership. A major role of the federal government (and of the National 
Science Foundation) since the early 1950*s has been to promote and 
support scientific research in American universities. This emphasis can 
easily lead to imbalanced development within universities* but it is the 
task of university leaders to allocate funds (derived from other sources) 
to maintain balanced institutions and to seek additional sources of 
support for nonscience activities. 

At the same time that the Science Development program was getting 
under way* state gQvemments were taking steps to improve and 
strengthen their own mechanisms for state planning in the field of higher 
education. The National Science Foundation received applications from 
state universities for Science Development grants directly and without 
the necessary endorsement of state governments. On the other hand* 
some state universities seeking Science t>evelopment grants did so with 
the encouragement and endorsement of their state governments. These 
state institutions tended to be those th^t were most successful in 
maintaining the gains made possible by Science Development. It is the 
stale governments* rather than federal government agencies* that must 
enforce the integrity of state planning for higher education; but federal 
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government ag'^ncics should be alert to the intricacies of such state 
planning. 

The model employed by Nsr to implement the program proved to be 
an effective mechanism for pursuing the objectives of the program 
without threatening the autonomy of the recipients. In the future a 
similar model might be applied to other endeavors, not necessarily 
restricted to the realm of science. For example, this approach could be 
used to encourage graduate schools to enroll more minority students and 
women. Professional schools might also benefit from this type of funding 
mechanism. In a limited sense the model is being applied currently in the 
new federal aid program for developing institutions. 

Since the Science Development prognim was a unique effort for nsf, a 
procedure for evaluating its impacts should have been built into the 
prognim at the very beginning, nsf did ask for final reports at the end of 
the grant period from each recipient, but these reports for the most part 
did not provide the type of data requirec^ for a full evaluation. 

One other conclusion must be mentioned. The Science Development 
prognim also served to strengthen the place of science research in the 
federal government scheme of rational priorities and to enhance the 
status of the National Science Foundation as a federal government 
granting agency. The program demonstrated the responsibility of the 
agency to an official directive of the Presfdent, and it evidenced the 
desire of nsf to acknowledge the concerns of legislators and others 
with geographical distribution of research grants. There are some who 
see the Science Development program as a capitulation to political 
pressure. It is mi^rc realistic io observe the program as a necessary 
response to the poliitcal process of a libenil democracy and of a federal 
stmcture of government. 

It is well to remind ourselves at this point of the two principal 
objectives of the Science Development program: to augment quality 
science research resources in the United Stales and to widen the 
geographical distribution of these resources'. These objectives were 
reasonable in the circumstances of l%5 and were realized to a consider- 
able extent. The program might have been judged as outstanding were it 
not for the fact that the duration of the program funding was not 
sufficient to have made a full impact upon the institutions involved. The 
institutions have had to carry on beyond the first stage of development 
made possible by nsf grants in an economic environment very different 
from that foreseen at the program's beginning. In some instances, the initial 
gains made possible by the development grants may be lost, victims of 
financial stringency. The ultimate judgment on whether the gains made 
possible by the Science Development program were worth their cost to 
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society must await the outcome of the stresses that currently cloud the 
future of advanced education and research in the nation's universities. 



* * * 

An evaluative study on occasion becomes no more than a forum from 
which to plead for more federal funds. That is not the intention here. 
The conditions that gave rise to the Science Development program of 
the National Science Foundation have changed. The emphasis in the 
federal government research effort is concentrated upon project re- 
search, with a growing disposition to direct that research to particular 
national needs. The concern to build new centers of academic excel- 
lence, or of science research excellence, has subsided, A federal effort 
to develop institutional competence, as research universities is not likely 
to be repeated in the near future; however, the concern wi^h institutional 
development remains, in the federal government, in state, governments,^ 
and elsewhere. Accordingly it is appropriate to set forth suggested ^ 
guidelines that have been confirmed by the experience of the present 
study and may be useful in future programs, 

1, Any endeavor at institutional development requires certain defi- 
nite conditions for success. These include broad but f.arly explicit 
national or other objectives, a sizable infusion of funds, careful institu- 
tional planning, adequate peer review of institutional potential for de- 
velopment, flexible management with a minimum of bureaucratic con- 
trol, and assurance of continued institutional ability to sustain the 
impiovements made possible by the development program, 

2, If institutional excellence is an objective, then a positive plan for 
such achievement— a plan that has some reasonable prospect of 
realization— is essential. 

3, The institutions to receive development grants should be selected 
on the basis of as objective and clearly specific criteria as possible, 

4, It is essential that institutions (and state governments, where 
applicable) have a full understanding of the obligations they assume by 

^.participating in the development program and that they make adequate 
preparations to fulfill those obligations, 

5, Some elasticity in the implementation o\ the devefopment plan is 
as important as the element of accountability. Close and cooperative 
communication is desirable between the recipient institution and the 
granting agency. When there is reason to change or modify the develop- 
ment emphasis, the program management should be flexible enough to 
allow for such adjustment, 

6, Any federal program that attempts to promote institutional de- 

42 



velopment is certain to encounter circumstances and conditions over 
which the federal government is nol prepared to exercise control, since 
its commitment to higher education is a partial and limited one. The 
federal government has shown no disposition to take over the role of 
either state governments or of philanthropists, nor is any such assump- 
tion of responsibility desirable national policy. But the limited nature of 
the federal role needs to be recognized and acknowledged, and federal 
agencies must be circumspect in observing those limitations. 

7. A development program need not be focused solely upon the 
advancement of particular disciplines. Other approaches appropriate to 
other circumstances may be in order. The disciplinary focus of the 
Science Development program is not the only possible model, although 
this emphasis was essential given the objectives of the Science De- 
velopment effort. 

8. A definite procedure for evaluation should be included in the 
desigi of an institutional development program. Assessment of perfor- 
mance is a continuing process and should be an ongoing part of the 
development program. Evaluation should be as precise as possible, 
concentrating upon a few limited measures clearly related to the objec- 
tives of the program itself. ^ 

9. A development program may be urgently needed at one particular 
time and be much less needed at another time. The ability to terminate a 
particular line of development is just as important as the ability to 
initiate one. The capacity to change remains an essential of government 
and of higher education activity and policy. 
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Appendix 

Science Development Awards 



University Science Development Recipients (funds in thousands of dollars) 





Initial Award 




Supplementary Award 


Institution 


Date 


Amount 


Date 


Amount 


Arizona 


07-02-65 


S4,045 


06-10-69 


$3,182 


Camcgie-Meilon 


05-10-67 


4,399 


05-26-72 


450 


Case Western Reserve 






05-31-68 


2.160 


Case Institute 


05-13-65 


3.500 






Western Reserve 


05-13-65 


3,500 






Colorado 


06^30-65 


3.755 


03-31-70 


1,676 


Duke 


12-20-66 


2,527 


05-26-72 


650 


Rorida 


07-02-65 


4,240 


02-07-69 


1,688 


Flonda State 


03-21-68 


4,820 


05-26-72 


1,200 


Georgia 


08-29-67 


3,719 


03-31-70 


2,276 


Indiana 


12-20^ 


7.886 


05-26-72 


1,470 


Iowa (Iowa City) 


08-29-67 


5,101 


05-20-71 


612 


Louisiana State 


05-31-68 


3.787 


03-31-70 


2.429 


Maryland 


05-10-67 


3,703 


05-20-71 


652 


Michigan State 


05-31-68 


4,307 


05-26-72 


1,180 


New York University 


06-10-69 


4,560 


05-26-72 


1,600 


North Carolina 


05-10-67 


4,995 


05-20-71 


1,071 


North Carolina Slate 


05-19-66 


3.555 


05*20-71 


678 


Notre Dame 


05-10-67 


4,766 


05-20-71 


451 


Oregon 


03-05-70 


4,000 


12-31-69 


2,748 


Pittsburgh 


06-10-69 


3,650 


05-26-72 


800 


Polytechnic Institute. 


11-03-65 


3.332 


02-06-69 


1,210 



Brooklyn 
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Univ«rtlty Sci«nc« D«v«lopm«nt R«cipi*nt»— Continued 



Institution 



" Purdue 
Rke 

Rochester 
Rutgers 
Texas 
Tulane 

use 

VanderbUt 
Vtjgmui 

Washington (Seattle) 
Washington (St. Louis) 



InitiaJ Award 



Date Amount 



05-19-66 


3*600 


06.30^5 


2»390 


06-30^5 


4,500 


05-IM6 


3,708 


05-2(V.71 


5,000 


05-20-71 


3,685 


n-03-65 


4,473 


05-1(^7 


4,053 


06.3(V«5 


3,780 


05-3 1 -«8 


5*000 


05-13-65 


3,919 



Supplementary Award 



Date Amount 
05-26-72 300 



12-31-69 


1,205 


05-20-71 


334 


05-20-71 


959 


05-20-71 


673 


02-07-69 


3.000 


05-26-72 


1,350 


06- 10-^., 


1,904 


05-20-71 


906 


02^7-69 


3,090 



Special Sdenctt Development Recipients (funds in thousands of dollars) 



Institution 


Date 


Amount Awarded 


Area 


Brandeis 


03-19-70 


$1,900 


chemistry, physics 


Connecticut 


03-31-70 


145 


environmental science 


Kansas State 


06-10-69 


819 


biology 


Kentucky 


03-20-6« 


974 


mathematics 


Nebraska 


03-26-69 


830 


chemistry 


New Mexico State 


04-12-66 


700 


mathematics 


Northwestern 


05-i9-70 


L500 


urhan systems engineering 


SUNY Stony Brook 


03-19-70 


2,000 


astronomy and astrophysics 


Tennessee 


03-20-6« 


1 .450 


chemical and metal engineering. 


Wayne State 






physics 


05-01-67 


919 


chemistry 


West Virginia 






University 


03.08-67 


700 


engineering 
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D«p«rtmtnUt Sci«nc« Dtvtlopmtnt AedpionU <fundt in dollars) 



Institution 


Date 


Amount Awarded 


Area 


Alaska 


04.3l).70 


$ 720.000 


geology 


Arizona State 


03-26-69 


650.000 


solid state science 


Boston University 


03-0.^-70 


650.000 


biological science 


Bowling Green 


03-26-69 


531.900 


psychology 


Bryn Mawr 


05-23-69 


403.000 


biochemistry 


Cdlifomia. San Uiego 


0«M5-70 


57I.0(K) 


economics 


California. Santa Barbara 


1)9-15-70 


480.000 


electrical engineering 


California. Santa Cruz 


03-26-69 


600.000 


astronomy 


Claremont 


05^31-68 


491.500 


mathematics 




04-09-71 


466.000 


psychology 


Clark 


06-12-67 


545.070 


psychology 




03-26-69 


563.740 


geography 


Clarkson 


03-26-69 


800.000 


chemical engineering 


Clem son 


03-05-70 


650.000 


engineering 


Colorado School of Mines 


04-30-70 


700.000 


geosci- mineral resources 


Colorado State 


03-05-70 


600.000 


civil engineenng 


CUNY. City College 


05-31-68 


765.000 


physics 


CUNY. Hunter College 


05-31-68 


617.800 


biolog> 


Delaware 


02-16-68 


556.000 


physics 


l>cnver 


05-31-68 


500.000 


mathematics 


Drexet Institute 


06-12-67 


527.71K) 


chemical engineering 


Emory 


09-15-70 


.S62.000 


chemistry 


Georgetown 


04-30-70 


460.000 


language and linguistics 


Hawaii 


04-30-70 


606.000 


chemistry 


Houston 


1)9-28-67 


420.000 


chemical engineering 


Illinois. Chicago Circle 


05-31-68 


545.000 


chemistry 


Illinois Institute of 


0^26-69 


800.1KK) 


biology 


1 echnology 








Kent State 


0^0*1-70 


41K>.IKKI 


psychology 


Lehigh 


09-28-67 


550.000 


metallurgy and material 
sciences 




09-17-69 


670.00(J 


mechanical engineering 
and mechanics 


Louisiana State. NewOrleans 


05-31-68 


477.800 


chemistry 


Louisville 


05-31-68 


500.000 


psychology 


Marquette 


09-28-67 


540.000 


biology 


Massachusetts 


04-09-71 


582.000 


psychology 


Michigan Tech. 


03-26-6V 


384.500 


engineering 


Mississippi 


12-29-69 


400.000 


electrical engineering 


Missouri 


09-28-67 


550.000 


physics 


Montana 


04-09-71 


500.000 


geology 


Nebraska 


03-26-69 


715.000 


physics 


New Hampshire 


03-05-70 


480.000 


psychology 


New Mexico 


06-12-67 


550.000 


mathematics 



o 
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Departmental Science Oeveropment Recipients— Continued 



InstKutioii 



, — . 

Oakland 




05.3 1-6« 


Ohio 


0M6.^8 


Oklahoma State 


0V26.69 


Oreijon State 


()V05-7() 


Rochester 


(M-()9-7| 


RPI 


0:.|f)-6« 




()6-^()-f)9 


SMU 


()2-lf).6« 




(M-05-70 




(M-()y.7I 


South Carolina 


05-23-69 


Stevens Institute 


09-17-69 


SUNY. Albany 


0V:6-69 




09-l<i-70 


SUNY. Binghamton 


05-^l-6« 




03-05-70 


lennessee lech 


06-12-67 


lexas A&M 


03-26-69 




09-15-70 


lexas lech 


09-15-70 


Utah 


06-09-69 




(n^- 15-70 


Utah Slate 


05-M-6K 


vpi 


09-17-69 


Washington State 


05.^l-6« 




O9-IS.70 


Wesley an 


05.^1-6« 


William and Mary 


0V()<i.70 


Wisconsin. Milwaukee 


02-l6-6« 


Wyoming 


02-l6-6« 


Yale 


05-27-71 


Yeshiva 


12-22-69 



Ainoiifu Auaidrd Aira 



570.(KK) 


engineering 




ph>sics 


665. 2(K) 


systems science 


600.(K)0 


chemistry 


848,(KK) 


fundamental studies 




(multidisciplinary) 


^69,000 


mathematics 


490. (KH) 


chemistry 


61K).(K)0 


electrical engineering 


550.(KK) 


ecvmomics 


6(K).(KX) 


anthropx)logy 


^(K).O(K) 


chemisiiy 


670.000 


physics 


480.(KK) 


mathematics 


525.(H)0 


biological sciences 


500.000 


geology 


390. (HH) 


economics 


^00.000 


mechanical engineering 


^60.1KK) 


chemistry 


458 .(KX) 


economics 


476.000 


electrical engineering 


720.01K) 


physics 


695. (KM) 


chemistry 


5S0.000 


ecology 


S(K).(KK) 


geological sciences 




chemical physics 


VMI.OOO 


sociology 


560.(XX) 


physics 


6I0.(K)0 


physics 


550.(KK) 


surface studies 


477. (KM) 


geology 


^00.0(K) 


social sciences 


9(K).(KK) 


physics 
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NATIONAL BOARD ON GRADUATE EDUCATION 
PUBLICATIONS 



Board Reports 

1. Graduate Education: Purposes, Problems and Potential, November 
1972, 18 pp. 

2. Doctorate Manpower Forecasts and Policy, Novern^<*r 1973, 22 pp. 

3. Federal Policy Alternatives Toward Graduate Education, March 
1974, 127 pp. 

4. Science Development, University Development and the Federal 
Government, June 1975 , 48 pp 

Technical Reports 

TR 1. An Eionomii Perspective on the Evolution of Graduate Education, 

by Stephen P. Dresch, March 1974, 76 pp. 
TR 2. Forecasting the Ph.D. Labor Market: Pitfalls for Policy, by Richard 

Freeman and David W. Breneman, April 1974, 50 pp. 
TR 3. Graduate School Adjustments to the '*Ne\v Depression ' in Higher 

Education, by David W. Breneman, with a Commentary by the 

National Board on Graduate Education, February 1975, % pp. * 
TR 4. Science Development: An Evaluation Study, by David E. Drew, 
June 1975, 182 pp. 

Other Publications 

An Annotated Bibliography on Graduate Education, 1971-1972, 
..October 1972, 151 pp. f 

^Xomment^' on the Newman Task Force Report on the Federal 
Role in Graduate Education, June 1973, 13 pp. 



